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Abstract 

We study the effect of query order on computational power, and show that 
pBHj[i]:BHfc[i] — ^jjg languages computable via a polynomial-time machine given one 
query to the jth level of the boolean hierarchy followed by one query to the kth level 
of the boolean hierarchy — equals Rj+2fc_i_tt(-'^P) if J is even and k is odd, and equals 
R-^+2fe-tt(^P) otherwise. Thus, unless the polynomial hierarchy collapses, it holds that 
for each I < j < k: pBH,[i]:BH,[i] ^ pBH,[i]:BH, [i] ^ ^ ^^^^ ^ j^^-^^ 

We extend our analysis to apply to more general query classes. 



1 Introduction 

This paper studies the importance of query order. Everyone knows that it makes more 
sense to first look up in your on-line datebook the date of the yearly computer science 
conference and then phone your travel agent to get tickets, as opposed to first phoning your 
travel agent (without knowing the date) and then consulting your on-line datebook to find 
the date. In real life, order matters. 

This paper seeks to determine — for the first time to the best of our knowledge — whether 
one's everyday-life intuition that order matters carries over to complexity theory. 

In particular, for classes Ci and C2 from the boolean hierarchy |1^,11], we ask whether 



one question to Ci followed by one question to C2 is more powerful than one question to C2 
followed by one question to Ci. That is, we seek the relative powers of the classes p^i[i]:C2[i] 
and pC2[i^Ci[i]_ 

As is standard ||2^ , for any constant m we say A is m-truth-table reducible to B {A <m-tt 
B) if there is a polynomial-time computable function that, on each input x, computes both 
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(a) m strings xi,X2, - ■ ■ ,Xm and (b) a predicate, a, of m boolean variables, such that 
xi,X2, - ■ ■ , Xm and a satisfy: 

x£A a{xB{xi),XB{x2), - ■ ■ ,XB{Xm)), 

where xb denotes the characteristic function of B. For any a and b for which <^ is defined 
and for any class C, let RI{C) = {L \ {3C G C)[L <^ C]}. 

We prove via the mind change technique that, for j,k > 1: 

pBH,[i]:BH,[i] ^ / Ri+2fe-i-tt(NP) if J is even and k is odd 

1 R?+2fe-tt(NP) otherwise. 

Informally, this says that the second query counts more towards the power of the class than 
the first query does. In particular, assuming that the polynomial hierarchy does not collapse, 
we have that if 1 < j < A; then pBHj[il:BHfc[i] pBHfc[i]:BHj[i] ^jffg^. ^^less {j = A;) V (j is 
even A k = j + 1). 

The interesting case is the strength of pBHj[i]:BHfc[i] -^j^gj^ j jg even and k is odd. In 
some sense, j + 2k NP questions underpin this class. However, by arguing that a certain 
underlying graph must contain an odd cycle, we show that one can always make do with 
j + 2k — l queries. We generalize our results to apply broadly to classes with tree-like query 
structure. 



The work of this paper (especially Theorem 3^), which first appeared in |2l|, should be 
compared with the independent work of Agrawal, Beigel, and Thierauf, which first appeared 
in [||. In particular, let pBHj[i]:BHfc[i]+ denote the class of languages recognized by some 
polynomial-time machine making one query to a BHj oracle followed by one query to a BH^ 
oracle and accepting if and only if the second query is answered "yes." Agrawal, Beigel, 
and Thierauf prove (using different notation): 

pBH, [i]:BHfe[i]+ ^ I BHj+2fe-i ^ j ^ k (mod 2) 

I BHj_(_2A: otherwise. 



Note that this result is incomparable with the results of Theorem 3^, as their result 
deals with a different and seemingly more restrictive acceptance mechanism. Some insight 
into the degree of restrictiveness of their acceptance mechanism, and its relationship to ours, 
is given by the following claim (Corollary |3.7| ), which follows immediately from Theorem 5.7 
and Lemma 5.9 of |l| and Theorem of the present paper: 

PP .pBH,[i];BH,[i]+N _ / P^"^-''''^™'™ if i is odd and /c is even 

^i-ttiP )- \ pBH,[i]:BH,[i] otherwise. 



2 Preliminaries 

For standard notions not defined here, we refer the reader to any computational com- 
plexity textbook, e.g., [I^j2|,p7|. Let XA, m-truth-table reducibility ("<m_tt")i R'a(C)) ^'^d 
pBHj [i]:BHfc[i]+ defined in Section |. 
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The boolean hierarchy pl]| , pl| is defined as follows, where C1QC2 = {L\ {3 A G Ci){3B € 
C2)[L = A-B]}. 

BHi = NP, 
BHfe = NP e BBk-i, for k > 1, 
coBHfc = {L I L G BHfc}, for k > 0, and 
BH = y BHi. 

i>l 

The boolean hierarchy has been intensely investigated, and quite a bit has been learned 
about its structure (see, e.g., |lO|,|ll|,|j2|,|2|,|^,|l|,|J| ) . Recently, various results have also 
been developed regarding boolean hierarchies over classes other than NP @,||,|,|2|. 

For any language classes Ci and C2, define p'^i[i]:C2[i] ^j^g class of languages accepted 
by polynomial-time machines making one query to a Ci oracle followed by one query to a 
C2 oracle. For any language classes Ci, C2, and C3, define p'^i[i]-<^2[i],C3[i] ]-,g ^j^g class of 
languages accepted by polynomial-time machines making one query to a Ci oracle followed 
in the case of a "no" answer to this first query by one query to a C2 oracle, and in the case 
of a "yes" answer to the first query by one query to a C3 oracle. 



3 The Importance of Query Order 

We ask whether the order of queries matters. We will study this in the setting of 
the boolean hierarchy. In particular, does P^Hj[i]:BHfe[i] gq^g,! pBHfe[i]:BHj[i]^ ^^ley 

incomparable, or does one strictly contain the other? 

For clarity of presentation, we will in this section handle classes only of the form 

pBH, [l]:BHfe[l]_ ^g gi^Q^ ^-^^^ foj. j^t g^^g pBH, [l]:BHfc[l] pBH^, [1]:BH,, [1] 

incomparable. In Section ^ we will handle the more general case of classes of the form 
pBHj[i]:BHfc[i],BHi[i]^ ^^^^ even classes with a more complicated tree- like query structure. 

Indeed, we show in this section that in almost all cases, p^^j[i]-BHfe[i] jg gQ powerful 
that it can do anything that can be done with j + 2k truth-table queries to NP. Since, 
based on the answer to the first BHj query, there are two possible BH^, queries that might 
follow, j + 2k is exactly the number of queries asked in a brute force truth-table simulation 
of P^Hj [i]:BHfc[i]_ Thus, our result shows that (in almost all cases) the power of the class is 
not reduced by the nonlinear structure of the j + 2k queries underlying p^Hj[i]:BHfe[i] — i^j^^t 
is, the power is not reduced by the fact that in any given run only j + k underlying NP 
queries will be even implicitly asked (via the BHj query and the one asked BH^ query) . We 
say "in almost all cases" as if j is even and k is odd, we prove there is a power reduction of 
exactly one level. 

All the results of the previous paragraph follow from a general characterization that we 
prove. For j,k > 1: 

pBH, [i]:BHfc[i] ^ / Rj+2fc-i-tt(NP) if j is even and k is odd 

1 R^+2fc-tt(NP) otherwise. 
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Our proof employs the mind change technique, which predates complexity theory. In par- 
ticular we show that pBHj[i]:BHfe[i] -j^^^g most j + 2k {j + 2k — 1 if j is even and k is 
odd) mind changes, and that BHj_|_2fc (BHj+2fc-i if j is even and k is odd) is contained in 

pBHj[l]:BHfc[l]^ 

The mind change technique or equivalent manipulation was applied to complexity theory 



in each of the early papers on the boolean hierarchy, including the work of Cai et al. ([10|, 



see also |32,r2[), Kobler et al. and Beigel |Q. These papers use mind changes for a 
number of purposes. Most crucially they use the maximum number of mind changes (what 
a mind change is will soon be made clear) of a class as an upper bound that can be used 
to prove that the class is contained in some other class. In the other direction, they also 
use the number of mind changes that certain classes — especially the classes of the boolean 



hierarchy due to their normal form as nested subtractions of telescoping sets |10] — possess 
to show that they can simulate other classes. Even for classes that have the same number of 
mind changes, relativized separations are obtained via showing that the mind changes are 
of different character (mind change sequences are of two types, depending on whether they 
start with acceptance or rejection). The technique has also proven useful in many other 
more recent papers, e.g., [p^|l^ ,p[|. 

To make clear the basic nature of mind change arguments, in a simple form, we give an 
example. We informally argue that each set that is /c-truth-table reducible to NP is in fact 
inR?_tt(BHfe). 

Lemma 3.1 For every k>l, R^_^^(NP) = R?_tj(BHfc). 



Proof This fact (stated slightly differently) is due to Kobler et al. |25|, and the proof 
flavor presented here is most akin to the approach of Beigel j^. Consider a fc-truth-table 
reduction to an NP set, F. Let L be the language accepted by the fc-truth-table reduction 
to F. Consider some input x and without loss of generality assume k queries are generated. 
Let us suppose for the moment that the reduction rejects when all k queries receive the 
answer "no." Consider the fc-dimensional hypercube such that one dimension is associated 
with each query (0 in that dimension means the query is answered no and 1 means it is 
answered yes). So the origin is associated with all queries being getting the answer no and 
the point (1,1, ...,1) is associated with all queries getting the answer yes. Now, also label 
each vertex with either A (accept) or R (reject) based on what the truth-table would do 
given the answers represented by that vertex. So under our supposition, the origin has 
the label R. Finally, label each vertex with an integer as follows. Label the origin with 0. 
Inductively label each remaining vertex with the maximum integer induced by the vertices 
that immediately precede it (i.e., those that are the same as it except one yes answer has 
been changed to a no answer). A preceding vertex v with integer label i induces in a 
successor v' the integer i -|- 1 if f and v' have different A/R labels, and i if they have the 
same label. Note that vertices given even labels correspond to rejection and those given odd 
labels correspond to acceptance. Informally, a mind change is just changing one or more 
strings from no to yes in a way that moves us from a vertex labeled i to one labeled i + 1. 
For 1 < i < fc, let Bi be the NP set that accepts x if (in the queries/labeling generated by 
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the action of the truth-table on input x) for some vertex v labeled i all the queries v claims 
are yes are indeed in the NP set F. Note that i?i 3 -B2 ^ i?3 2 • • as if a node labeled 
V is in Bj, j > 2, then certainly its predecessor node with label j — 1 must be in Bj_i, as 
that predecessor represents a subset of the strings v represents. But now note that L is 

exactly Bi — {B2 — (S3 — ( (-Bfe-i — -Bfe) • • •)))■ Why? Let the vertex w (say with integer 

label iu,) represent the true answers to the queries. Note that by construction, x £ Bq for 
all q < iw but x ^ Bq for any q> iyj. As the Bi were alternating in terms of representing 
acceptance and rejection, and given the format Bi — {B2 — (-B3 — (••• — {Bk_i — B^) ■ ■ •))), 
the set Bi — {B2 — (-B3 — (•.• — {B^-i — Bk) ■ ■ ■))), will do exactly what Bi^ represents, 
namely, the action on the correct answers. Thus, we have just given a proof that a fc-truth- 
table reduction that rejects whenever all answers are no can be simulated by a set in BH^. 
Of course, one cannot validly assume that the reduction rejects whenever all answers are 
no. But it is not hard to see (analogously to the above) that the case of inputs where the 
reduction accepts when all answers are no can (analogously to the above) be handled via 
the complement of a BH^ set, and that (since what the truth-table reduction does when 
all answers are no is itself polynomial-time computable) via a set in R^_^^(BHfe) we can 
accept an arbitrary set in ^.^(NP). Of course, it is clear by brute force simulation that 
R?_tt(BHfc) C R^_^^(NP), and so it holds that R?_tt(BHfc) = R^_^^(NP). | 

What actually is being shown above is that R]'.^^(BHfc) can handle k appropriately 
structured mind changes, starting either from reject or accept. In the following theorem, 
the crucial things we show are that (a) P^HjIil'^^fcli] simulate, starting at either accept 
or reject, j + 2k (respectively, j + 2k — 1) mind changes if j is odd or k is even (respectively, 
if j is even and k is odd), and (b) for j even and k odd, p^^il^l-^^fclil can never have more 
than j + 2k — 1 mind changes. We achieve (b) by examining the possible mind change flow 
of a P^Hj[i]:BHfc[i] jjiachine, j even and k odd, and showing that either a mind change is 
flagrantly wasted, or a certain underlying graph has an odd length directed cycle (which 
thus is not two-colorable, and from this will lose one mind change). 

Since our arguments in the proofs of this section use paths in hypercubes, we will 
find useful the concept of an ascending path in a hypercube. Let K = {0, 1}'^ be the d- 
dimensional hypercube. Then every path p m K can be described as a linear combination 
of unit vectors ui, . . . , Ud, where Ui is the ith unit vector. We call p an ascending path in 
K leading from (0, 0, • • • , 0) to v if and only if it can be identified with a sum 

Ui^+Ui^-\ h Ui^ 

of distinct unit vectors u^, such that the vertices of this path p are 

= (0, • • • ,0),i;i = Ui^,V2 = Ui^ +Ui^, ■ ■ ■ ,v = Ui^ +Ui^ -\ h Ui„. 

We will call this sum the description of p. Note that the order of the u's matters, as 
a permutation of the ?i's results in another path. We call p an ascending path (without 
specifying starting point and endpoint) if p is an ascending path leading from (0, 0, • • • , 0) 
to (1,1, •••,!). 
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Before turning to results, we will first study the structure of ascending paths in labeled 
hypercubes and give some necessary definitions. Building upon them, we will then prove 
Lemma which states that p^f^jl^l-^^ifcti] can handle exactly j + 2k {j + 2k — l if j is even 
and k is odd) mind changes. 

Let M be a pBHj [i]:BHfe[i] ^lachine with oracles A € BH^ and B G BH^ and let x £ S*. 
On input x, M first makes a query qi{x) to A and then if the answer to the first query 
was "no" asks query q2 (x) to B and if the answer to the first query was "yes" asks query 
93 (x) to B. Without loss of generality assume that on every input x exactly two queries 
are asked. 

Every set C S BH; can be written as the nested difference of sets Ci, C2, ■ • • , Q G NP 
C = Ci-{C2 -{■■■- {Ci^i -Ci)-- •)) 
and following Cai et al. jl^ we even can assume that 

Hence a query "(7 G C?" can certainly be solved via / queries "g G Ci?," G C2?," • ■ ■ , 
"g G Q?" 

In light of this comment, we let 

A = Ai-{A2-{ (Aj^i-Aj)---)) where G NP for i = l,2,---,j 

and Aj Q ■ ■ ■ <^ Al, and 

B = Bi-{B2-{ {Bk^i - Bk)-- ■)) where G NP for f = 1, 2, • • • , /c 

and -BfcC-.-CSi. 

For the sake of definiteness let us assume that the queries 

qi{x) G Al, • • ■ ,qi{x) G Aj,q2{x) G -Bi, • • ■ ,q2{x) G Bk,qz{x) G -Bi, • • ■ ,q2.{x) G Bk 

correspond in this order to the j + 2k dimensions of the (j + 2A;)-dimensional hypercube 
H = {0, More precisely, a vector (oi, • • • , aj+2fe) G is understood to consist of the 

answers to the above-mentioned queries, where means "no" and 1 means "yes." 

Since a query "9 G CT for some C G BH^ and C = Ci - {C2 - {■ ■ ■ (Cz_i - Ci) ■ ■ ■)) 
can be solved by evaluating the answers to G Ci?," "g G C2?," "g G C/?" every 
node V G H gives us answers to "gi(x) G A?" (by evaluating the first j components of v), 
to "(72(2;) £ -B?" (by evaluating the k components of v that immediately follow the first j 
components of v) and to "53 (x) G B?" (by evaluating the last k of v^s components). This 
gives us a labeling of all vertices of H. We simply assign label A (Accept) to vertex v & H 
if M^[^l^-^[i] (x) accepts if the answers to the two asked questions are as determined hy v. If 
jy^yl[i]:B[i]^2;) rejects in this case we assign label R (Reject) to v. 

So let Hm{x) be the (j + 2A;)-dimensional hypercube labeled according to M^^^^'^^^^x). 
The number of mind changes on an ascending path p of Hm{x) leading from (0,0, • • • ,0) 
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to a vertex t is by definition the number of label changes when moving from (0, 0, • • • , 0) to 
t along p. The number of mind changes of an internal node v of Hm{x) is the maximum 
number of mind changes on an ascending path leading from (0, 0, ■ • • , 0) to v. And finally, 
the number of mind changes of a pBHj [i]:BHfc[i] niachine M is by definition the maximum 
number (we take the maximum over all x € S*) of mind changes of the vertex (1, 1, • • • , 1) 
in Hm{,x); in other words, this number is the maximum number of label changes on an 
ascending path in Hm{x) for some x € S*. 

We say we lose a mind change (between two adjacent vertices Vi and I'i+i) along an 
ascending path if when moving from Vi to Vj+i the machine does not change its acceptance 
behavior. 

One can easily verify the following fact: 

Fact 3.2 If M is a p^Ki[i]-^Hfe[i] fjiachine such that on input x the acceptance behavior is 
independent of the answer to one or more of the two possible second queries (that is, if for 
at least one of the second queries both a ''yes" and a "no" answer yield the same acceptance 
or rejection behavior), then we lose at least one mind change on every path in Hm{x)- 

So from now on, in light of Fact U, let M^W-^[^l(x) be a pBH,[i]:BHfc[i] j^achine that 
has, on input x, one of the following four acceptance schemes (the scheme may depend on 
the input). 

(1) M accepts if and only if exactly one of the two sequential queries is answered "yes." 

(2) M accepts if and only if either both or neither of the two asked queries is answered 

"yes." 

(3) M accepts if and only if the second query is answered "yes." 

(4) M accepts if and only if the second query is answered "no." 



Fact 3.3 If p is an ascending path in Hm{x) such that p contains adjacent vertices v and 
V + Ud such that 

d < j and the {d')th component of v is for some d' < d, 
then p loses a mind change. 

Proof Since A G BHj and thus A = Ai — {A2 — (••• — (Aj_i — Aj) ■ ■ •)) and there is a in 
the {d')th. component of v and v + both vertices yield the same answer to "gi(x) G A?" 
The 1 in the dth component of v + Ud has no effect at all on the answer to "^i(x) G A?" and 
so on the outcome of M'^^^^'^^^^x). Hence, both vertices have the same label and p loses a 
mind change. | 

Similarly, one can prove that if p is an ascending path and p contains two adjacent 
vertices v and v + uj, such that j<d'<d<j + k and the (d')th component of u is or 
j + k<d'<d<j + 2k and the {d')th component of f is then p also loses one mind 
change. 
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Furthermore, in hght of Fact 3.3, let us focus only on paths p that change their first 
j, second k, and last k dimensions from the smallest to the highest dimension in each 
group. This allows us to simplify the description of paths as follows. Let ei be the following 
operator on H: 

ei((«i, • • • ,«j+2fc)) = 

I (ai, • • • ,ai-i, 1, • • • ,aj+2k) if i < j, ai = A (Vj : j < i)[aj = 1] 
[ (ai, ■ ■ ■ , aj+2fc) otherwise. 

The operators 62 and 63 act on the index groups (j+1, • • • ,j+k) and {j+k+1, • • • , j+2k), 
respectively, in the same manner: the zero component with smallest index among the zero 
components is incremented by 1. The only reasonable paths to consider are those emerging 
from repeated applications of ei, 62 and 63 to (0, •••,0). We will use (cj^, e^j , • • • , .^j^.) 
to denote the path with vertices vq = (0, •••,0), vi = ei^{vQ),V2 = ei^{vi),--- , 
Vj+2k = ei^.^2,(?;j+2fc-i) = (1, 1, • • • , 1). 

The next fact gives sufficient conditions for an ascending path to lose a mind change, namely: 

Fact 3.4 On any ascending path p a mind change loss occurs if: 

Case 1.1 there is an 62 after an odd number of ei 's in the description of p, or 

Case 1.2 there is an 63 after an even number of ei 's in the description of p, or 

Case 2 the description of p contains a sequence of odd length at least 3 that starts and 
ends with ei and contains no other ei 's. 

Proof We will call the occurrence of Case 1.1 (Case 1.2) in p an "e2-loss" ("e3-loss") and 
the occurrence of Case 2 an "odd episode." In general we call a subpath of p of length at 
least 3 that starts and ends with ei and contains no other ei an episode. 

Intuitively p loses a mind change in the case of Case 1.1 (1.2), since in the actual 
computation M(x) does not really ask query q2ix) (q^^x)) and so a change in the answers 
to the k underlying NP queries of q2{x) ((73(3;)) does not affect the outcome of the overall 
computation. 

Intuitively in Case 2 the following argument holds. If the description of p contains an 
odd episode, say starting with e^ = ei and ending with Cj^, = ei, then vi-i,vi, • • • ,vii form 
an even-length subpath p' of p. If the odd episode contains both 62 's and 63 's then note 
that Case 1 applies and we are done. In fact due to Case 1, we may hence forward assume 
the odd episode, between the starting and the ending ei's, has only e2's (respectively e^s), 
if we have an even (respectively odd) number of ei's up to and including the ei starting 
the odd episode. So in this case and vi' have the same label Accept/Reject. The 
acceptance behavior of M^^^^'^^^^x) due to vi-i and Vf is the same, because after two ei's 
the answer to "(?i(a;) € A?" is the same as it was before the two ei's, and the e2's (es's) 
have not influenced the answer to 93 (x) {q2{x)). Thus we have a subpath of even length, 
namely vi-i,vi, ■ ■ ■ ,vi/ , whose starting point and endpoint have the same Accept/Reject 
label. To assign to each vertex of this path an Accept/Reject label in such a way that no 
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mind changes are lost is equivalent to the impossible task of 2-coloring an odd cycle. Hence 
we lose at least one mind change for every occurrence of an odd episode. | 

Before proving the main theorem of this section, we show the following lemma, 
Lemma 3^, which tells how many mind chang handle. We say a 



complexity class pBHj[i]:BHfc[i] handle exactly m mind changes if and only if (a) no 
pBHj [i]:BHfe[i] jjiachine has more than m mind changes and (b) there is a specific pBHj[i]:BHfc[i] 
machine that has m mind changes. It is known (see, e.g., [^,^,^) that ^_^(NP) can han- 
dle exactly k mind changes. 

Lemma 3.5 The class pBHj[i]:BHfe[i] handle exactly m mind changes, where 



m 




if j is even and k is odd 
otherwise. 



Proof We first consider the case in which j is even and k is odd. 

We want to argue that for every P^Kilil-^^fcl^l machine M and every x G S*, on every 
ascending path in the j + 2k dimensional, appropriately labeled, hypercube Hm{x) there 
are at most j + 2k — l mind changes. Let x G S* and M be a pB^ilil-B^fel^l machine with the 
oracles A and B. Due to Facts |3.3| and 3.2, it suffices to consider a pBHj[i]:BHfc[i] niachine 



M with one of the four previously mentioned acceptance schemes on input x and to show 
that every path p having the introduced description loses at least one mind change. Let 
M{x) be such a machine and p be such a path. There are two possibilities. 

Case A The description of p contains an e2-loss or an es-loss. 
According to Fact |3.4|, p loses at least one mind change. 



Case B The description of p contains neither an 62- loss nor an es-loss. 

Hence the description of p consists of blocks of consecutive 62 's and 63 's separated by 
blocks of ei's. Since the description of p contains k 63 's and k is odd, there is a block of 
63 's of odd size in p. Since we have no e3-loss and j is even this block is surrounded by 



ei's. Thus we have an odd episode in the description of p and, according to Fact |3.4 , 
p loses a mind change. 

So no pBHj[i]:BHfc[i] machine can realize more than j + 2k — 1 mind changes. 

It remains to show that there is a deterministic P^^j [^l-^^fclil machine and an input 
x € S* such that in the associated hypercube Hm{x) there is a path having exactly j+2k — l 
mind changes. 

Let us consider the path pQ, 

PO = (62,62,- •• ,62,61,61, ••• ,61,63,63, ••• ,63,61). 

V ' V ' V ' 

k j—1 k 

Consider the deterministic oracle machine W that asks two sequential queries and ac- 
cepts an input x if and only if the second query of W{x) was answered "yes" (acceptance 
scheme (3)). We know as just shown that all ascending paths of Hw{x) have at most 
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j + 2k—l mind changes. Note that for every x G S* the path po loses only one mind change 
and thus pBHj[i]:BHfc[i] handle exactly j + 2k — 1 mind changes. 

This completes the proof of the case "j is even and k is odd." We now turn to the "j is 
odd or k is even" case of the lemma being proven. 

Since our hypercube has (in all cases) j + 2k dimensions, certainly P^Hj[i]:BHfc[i] ^^^^ 
handle (in all cases) no more than j + 2k mind changes. 

If j is odd, we consider the path 

Pi = (62,62, • • • ,62,6l,ei, • • • ,61,63,63, • • • , 63) 

" V ' " V ' " V ' 

k j k 

and — using the acceptance scheme numbering introduced just after Fact — we consider 
the machine having for every input x acceptance scheme (3) or (1) for k odd or even, 
respectively. If j is even and k is even, we consider path pq and we consider the machine 
having acceptance scheme (1) for every input. 

In each of these cases the considered machine changes its mind along the associated 
path exactly j + 2k times. Hence for j odd or k even the class p^^^jlil-^^ifcli] can handle 
exactly j + 2k mind changes. I 

Now we are ready to prove our main theorem of this section. 

Theorem 3.6 For j, k > 1, 

pBH,[i]:BHfc[i] ^ f Ri+2fe-i-tt(NP) if j is Bveri and k is odd 

\ Ri+2A:-tt(NP) otherwise. 

Proof In order to avoid unnecessary case distinctions we prove the fact for arbitrary 
j and k and simply denote the appropriate number of mind changes by m, namely (see 
Lemma |3.5D j + 2k — 1 if j is even and k is odd and j + 2k otherwise. First we would like 
to show that p^^ilil-^^feli] c Rj^_j^.(NP). We show this by explicitly giving the appropriate 
truth-table reduction. 

Let A G pBHj[i]:BHfc[i] ^ ^Yie number of mind changes (according to Lemma 

|3.5| ) the class P^Hj[i]:BHfe[i] handle. Let M be a deterministic oracle machine, witnessing 
A G pBH,[i]:BHfc[i]^ ^jj^ ^j^g gg^g ^ gjjj and ^2 G BHfc. As noted by Beigel g, the set 
Q = {{x,k) I M(x) has at least k mind changes} is an NP set. Note that if M^^^'^^^^^x) 
on a particular input x rejects (respectively accepts) if both queries have the answer "no" 
then M'^i[^l''^2[^l(x) accepts if and only if the node (of the implicit hypercube) associated 
with the actual answers has an odd (respectively even) number of mind changes. 
Define the variables o,yi,y2, ■ ■ ■ , ym and the m-ary boolean function a: 
o = if M'^i[-^]''^2[^1 (x) rejects if both queries are answered "no," 
o = 1 if M'^i[^]''^2["'^l (x) accepts if both queries are answered "no," 
yi = 

V2 = (x,2), 
= (2;, 3), 
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and a{zi, z^-, - ■ ■ ■, Zm) = 1 *^=^ (max{/ 1 z/ = 1} + o) = 1 (mod 2). 

Clearly we can compute the just defined variables for a given x and also evaluate 
the function a at {xQ{yi)jXQ{y2), ■ ■ ■ ,XQiym)) in polynomial time. And finally we have 
x^A <^ a{XQ{yi),XQ{y2),- ■ ■ ,XQ(.ym)) = I- Thus ^ G R^_tt(NP). 

It remains to show that R^_tt(NP) C pBH,[i]:BHfe[i]_ Recall Rl_^^{lSSF) = R{_^^(BRk) from 
Lemma 3.1. Since the class pB^ijI^l-B^^feli] is closed under <:i_^^ reductions it suffices to prove 



So let B G BHm. Following Cai et al. [|lO| we may assume that the set B is of 
the form B = Bi - {B2 - {B3 - { - Bm) ■ ■ •))) with Bi,B2, • • • , S„ G NP and 

Bm C • • • C ^2 ^ ^1 • 

We show B G pBH,[l]:BHfe[l] 

using ideas of the second part of the proof of Lemma 
4.1, namely by implementing the specific good path pQ, respectively pi. B is accepted by a 
pBH,[i]:BHfc[i] niachine M as follows: 

Case 1 j is odd. 

Define the two oracle sets Oi and O2: 

01 = Bk+i — {Bk+2 -(••• — {Bk+j^i - Bk+j) ■ ■ ■)), and 

02 = {{y, 2) I y G i?i - (i?2 - (• • • - {Bk-i -Bk)-- •))} 

U{(2/,3) I y G Bj+k+i - (-Bj+fe+2 - ( (^i+2fc-i - -Bj+2fc) • ■ ■))}• 

Note that Oi G BHj and O2 G BH^. On input x M first queries "x G Oi." In case 
of a "no" answer M{x) queries {x,2) G O2 and in case of a "yes" answer to the first 
query M{x) asks (x,3) G 02- 

Case 1.1 k is odd. 

M{x) accepts if and only if the second query is answered "yes." 

Case 1.2 k is even. 

M{x) accepts if and only if exactly one of the two queries is answered "yes." 

Case 2 j is even. 

Define the two oracle sets Oi and O2' 

01 = Bk+i - {Bk+2 - ( {Bk+j-i - B,n) ■ • •))> and 

02 = {{y, 2) I y G i?i - (i?2 - (• • • - {Bk-i -Bk)-- •))} 

U{(y,3) I y G Bj+k - (Bj+k+i - ( (5m-2 - ^m-i) • • •))}• 



Note that Oi G BHj and O2 G BH^. On input x M first queries "x G Oi." In case 
of a "no" answer M(x) queries {x, 2) G O2 and in case of a "yes" answer to the first 
query M(x) asks (x,3) G 02- 

Case 2.1 k is odd. 

M{x) accepts if and only if the second query is answered "yes." 
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Case 2.2 k is even. 

M{x) accepts if and only if exactly one of the two queries is answered "yes." | 



It is interesting to note which properties of NP are actually required in the above proof 
for the result to hold. The proof essentially rests on the fact that the key set Q (describing 
that, for given x and m, the p^^il^l-^^fel^] machine M on input x has at least m mind 
changes) is an NP set. So considering an arbitrary underlying class C, for proving Q € C it 
suffices to note that Q is in the class 3^ ■ R^.btt(C),[| and to assume that C be closed under 
3^" and conjunctive bounded truth-table reductions. Indeed, the 3^ quantifier describes 
that there is a path in the boolean hypercube Hm{x)i and via the <^_^j^.^ -reduction it can 
be checked that this path is an ascending path and all the answers the vertices on that 
path claim to be "yes" answers indeed correspond to query strings that belong to the class 
C. Similar observations have been stated in earlier papers |^,^. In terms of the present 



paper, note in particular that the assertion of Theorem 3.6 holds true for all classes C closed 
under union, intersection, and polynomial-time many-one reductions. C=P, R, and FewP 
all have these closure properties, to name just a few examples. If the underlying class C 
is closed under polynomially bounded 3 quantification and unbounded conjunctive truth- 
table reductions, it is not hard to see that this analysis can even be done safely up to the 
case of logarithmically bounded query classes, as the number of paths in the hypercube is 
polynomial and thus generates a polynomial-sized disjunction. 

Theorem allows us to derive a relationship between classes of the form p^^^jI^l-BHfcli] 
and pBHj [i]:BHfe[i]+_ Qiassgg Qf latter form were studied in Q. 

Corollary 3.7 For every j,k > 1, 

pP /pBH,[l]:BH,[l] + N _ / pBHj-i[l]:BHfe[l] -jj ^ ^^^^ 

i-1 pBH,[i]:BH,[i] Otherwise. 



The proof is immediate by the results of Theorem 3.6 of this paper and Theorem 5.7 and 
Lemma 5.9 of [|l[|. 

From Theorem we can immediately conclude that order matters for queries to the 
boolean hierarchy unless the boolean hierarchy itself collapses. 

Corollary 3.8 1. If {j = k)\J {j is even and k = j + 1), 1 < j < k, then pBH,[i]:BHfe[i] = 

pBHfe[l]:BH,[l]_ 

2. Unless the boolean hierarchy (and thus the polynomial hierarchy) collapses: for every 
^ <j <k, pBHj[i]:BHfc[i] _^ pBHfc[i]:BH,[i] ^^/gg^ (j = fc) V (j is cvcn and k = j + 1). 

The corollary holds, in light of the theorem, simply because the boolean hierarchy and 
the truth-table hierarchy are interleaved |25] in such a way that the boolean hierarchy levels 



are sandwiched between levels of the bounded-truth-table hierarchy, and thus if two different 



^Here, <^_btt denotes the conjunctive bounded truth-table reducibihty, and for any class fC, 3^ ■ K, is 
defined to be the class of languages A for which there exists a set B £ JC and a constant bound m such that 
X £ A a and only if there exists a string y of length at most m with (a::, y) G B. 
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levels of the bounded-truth-table hierarchy are the same (say levels r and s, r < s), then 
some level (in particular, BHj.+i) of the boolean hierarchy is closed under complementation, 
and thus, by the downward separation property of the boolean hierarchy |1C], the boolean 
hierarchy would collapse. Furthermore, Kadin has shown that if the boolean hierarchy 
collapses then the polynomial hierarchy collapses, and Wagner, and Chang and Kadin, and 
Beigel, Chang, and Ogihara have improved the strength of this connection |p^,p9|,p!^j5[ . 

The strongest known connection is: If BH^ = coBHg, then PH = (^P(^^i)_tt) @) where 
NP X'^P 

Pm-tt denotes the class of languages accepted by P machines given m-truth-table access 



( 



m-tt J 

to an NP^^ oracle and also given unlimited access to an NP oracle (note that ( Piit't ) is 
equal to pNP'^^fi^NP ^ leading NP queries can be absorbed into the NP^^ query). 

In light of this discussion, we can make more clear exactly what collapse is spoken of 
in the second part of the above corollary. In particular, the collapse of the polynomial 

/ \ NP 

hierarchy is (at least) to (P(fc+2j)-tt ) -0 

Of course, Theorem p.6| applies far more generally. From it, for any j, /c, j', and A;', 
one can either immediately conclude equality, or can immediately conclude that the classes 

/ NP X'^P 
are not equal unless the polynomial hierarchy collapses to ( P(min(a(j k) a{j' fe')))-tt ) ' where 

a{a, b) equals a + 2b — 1 if a is even and b is odd and a + 2b otherwise. 

The point of Theorem 3^ is that from the even/odd structure of p^^ilil-^^fcl^l classes 

one can immediately tell their number of mind changes, and thus their strength, without 

having to do a separate, detailed, mind change analysis for each j and k pair. However, 

note that one can, via a time-consuming but mechanical procedure, analyze almost any 

class with a query tree structure (namely by looking at the full tree of possible queries and 

answers, and for each of the huge number of possible ways its leaves can each be labeled 

accept-reject compute the number of mind changes that labeling creates, and then look at 

the maximum over all these numbers). For example, one can quickly see that one query to 

DP followed by 4-tt access to NP yields exactly the languages in R^q ^.^(NP). 



4 General Case 

In the previous section, we studied classes of the form p^i^j[i]-^Hfe[i]_ completely 
characterized them in terms of reducibility hulls of NP and noted that in this setting the 
order of access to different oracles matters quite a bit. What can be said about, for example, 
the class pBH, [i]:BHfc[i]:BH,[i]? jg gq^al to pBHj [i]:BHfc[i],BH,[i]7 (^g'^ ^hat the answer is 

"no" in certain cases.) Even more generally, what can be said about the classes of languages 
that are accepted by deterministic oracle machines with tree-like query structures and with 



^Though one level is gained by the g — 1 in the Q| connection between the boolean hierarchy and the 
polynomial hierarchy, one level is lost in the collapse of the boolean hierarchy that follows from a given 
collapse in the truth-table hierarchy. We speculate that it might be possible for the k + 2j claim to be 
strengthened by one level by applying the j5| technique directly to the truth-table hierarchy. 
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each query being made to a (potentiahy) different oracle from a (potentially) different level 
of the boolean hierarchy? Is it possible that with a more complicated query structure we 
might lose even more than the one mind change lost in the case of pBKj [i]-^Hfe[i] ^[^]^ j even 
and k odd? (From the results of the section, it will be clear that the answer to this question 
is "yes"; mind changes can, in certain specific circumstances, accumulate.) 

First of all, we can immediately derive a characterization of the class pBHj[i]:BHfc[i],BH;[i] 
from the results of the previous section, namely: 

Theorem 4.1 For j,k,l > I, 

pBH, [i]:BHfc[i],BH,[i] ^ i Rj+fc+i-i-tt (^P) if j is even and I is odd 

\ P-j+fe+z-ttlNP) otherwise. 



Proof Note that in Lemma |3.5| we handle the special case of k = 1. However, notice that 
the mind change loss for j even and k odd is due only to the fact that the query made after 
the first query is answered "yes" is made to an oracle from an odd level, namely k, of the 
boolean hierarchy. In particular the mind change loss is not tied to the query we ask in 
case the first query is answered "no." Thus we have 

Claim The class pBHj[i]:BHfc[i],BH;[i] ^^^^ handle exactly m mind changes where 



m 



j + k + I — 1 if J is even and I is odd 

j + k + I otherwise. 



Similarly to the proof of Theorem one can now show the equality we claim. 
Note that for every j, k,l > 1, we obviously have 

pBH, [1] :BHfe [1] ,BH, [1] ^ pR^'.^ (BH, ) ll]:Rl^^ (BH^ ) [1] ,R^_^^^ (BH,) [1] 



and thus the following corollary holds. 
Corollary 4.2 For j,k,l > 1, 

pR^_^JBH,)[i]:R^_^^(BHfe)[i],R^_tt(BH,)[i] ^ f Pj+fc+i-i-tt (^P) if j is even and I is odd 

\ Rj'+fc+i_tt(NP) otherwise. 

The last corollary is the key tool to use in evaluating any class of languages that are 
accepted by deterministic oracle machines with tree-like query structures and with each 
query being made to a (potentially) different oracle from a (potentially) different level of 
the boolean hierarchy. 

We formalize some notions to use in studying this. Let T be a binary tree, not necessarily 
complete, such that each internal node Vi (a) has exactly two children, and (b) is labeled 
by a natural number rij (whose purpose will be explained below). For such a tree T, define 
/t by /r(fi) = ni. Henceforward, we will write / for Jt in contexts in which T is clear. 
Let rootT be the root of the tree (we will assign to this node the name vi) and let LTt 
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n2 = 2 



leaf 



Figure 1: Tree T 



and RTt respectively be the left and right subtrees of the root. We will denote the class of 
sets that are accepted by a deterministic oracle machine with a T-like query structure by 
p(^\ Here the structure of the tree T gives the potential computation tree of every P^"^-* 
machine in the sense that inductively if a query at node v is answered "no" ("yes") we keep 
on moving through the tree in the left (right) subtree of v. And at each internal node Vi 
of T the natural number nj gives the level of the boolean hierarchy from which the oracle 
queried at that node is taken. 

For example consider the tree T (see Figure ||), in which f{vi) = 2, f{v2) = 2, /(vs) = 4, 
/('U4) = 1, and /(W5) =3. A P*^"^) machine works as follows. The first query is made to a 
DP oracle. If the answer to that first query is "no" a second query is made to the DP oracle 
associated with V2, and if the answer to the first query is "yes" the second query is made 
to the BH4 oracle associated with V3. A third query is made only if the answer to the first 
query is "yes" ; in this case, the oracle set of the third query is in NP if the answer to the 
second query is "no," and is in BH3 if the answer to the second query is "yes." Note that 
for every input x € S* every p(^) machine M(x) assigns a label A (Accept) or R (Reject) to 
each leaf of T with its own specific acceptance behavior (which, in particular, may depend 
on x). 
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If T is the complete tree of depth 1 (i.e., a root plus two leaves), then by definition 
m(T) = f[rootT) , and otherwise define 

f firootr) + m{LTT) + m{RTT) - 1 if firootr) = (mod 2) and 
m(T) = I m{RTT) = 1 (mod 2) 

I f{rootT) + m{LTT) + m{RTT) otherwise. 

For our example tree T we have m{T) = 10. The main theorem of this section will 
prove m(T) determines the number of bounded truth-table accesses to NP that completely 
characterize the class P^^^. It follows from the main theorem that, for example, p(^) = 

RVtt(NP). 

Theorem 4.3 p(^) = R^(^j_^^(NP). 

Proof The proof consists of an obvious induction over the depth d of the tree. Note that 



the correctness of the base case of the induction, d = 2, is given by Theorem 4.1. The proof 
of the inductive step follows immediately from the obvious fact that 

p(T) ^ pB%(.„„,^):P(^TT),p(flT:r) 



combined with Lemma |]| (R^_tt(NP) = R?_tt(BHfc)) and Corollary |]|. | 

Finally, we mention that a study of query order in the polynomial hierarchy (as op- 
posed to the boolean hierarchy) has very recently been initiated by E. Hemaspaandra, 
L. Hemaspaandra, and H. Hempel ([0], see also [31, |]) and this study has led to a somewhat 
surprising downward translation result: For k > 2, T,^ = 11^ <^=^ P^fcl^l = P^fcP] (|ji6|^ 
see also the extensions obtained in plpH]). Query order (see also the survey [|l^) has also 



recently proven useful in studying the structure of complete sets [18| and in characterizing 
bottleneck-computation classes p^. 
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